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rently accessing the host computer systems via the network 
access server and performing typical data transfers. 
Preferably, each simulated test user employs unique network 
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computer system, respectively. 
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NETWORK ACCESS SERVER TESTING user PCs 410. For PPP, each user PC is assigned an IP 

SYSTEM AND METHODOLOGY (Internet protocol) address for Internet communications. An 

IP address has four octets, each octet specifying a number 

TECHNICAL FIELD fjom 0-255. When written in a human-readable fonnat, the 

The present invention relates to computer networking s octets of an IP address arc often separated by periods, for 

and, more particularly, to a system and methodology for example,"10.Ll.l". As well known in the art, ISP hosts 450 

testing network access servers. can be configured to use other communications protocols 

uAnvnnrt tntfi ^"^^ ^ ^^^^ (single-liae Internet protocol). 

BACKGROUND ART ^^^^ jgp j^^^j computer system 450 also has an IP 

The Internet is a rapidly growing, world-wide network of address, the user PC 410a and the ISP host 450 can com- 
computer systems. One reason for the current popularity of municate with each other using standard Internet protocols 
the Internet is electronic mail (email). Users can send and specifying their IP addresses. For example, a user can 
receive email messages to friends, family members, and download files from ISP host 450, e.g. text and graphics, or 
business contacts artjund the nation and indeed the world upload files to ISP host 450. These files can include corn- 
within minutes. Furthermore, the World-Wide Web is P^ter programs, graphics, and documents. ISP host 450 has 
another popular aspect of the Internet. The World-Wide Web access to an Internet connecUon 460. 
features information stored in "home pages" or "web pages" Some common Internet activities for users involve down- 
in the form of text, graphics, audio, and even video files at loading a large number of files. For example, a user may 
various sites in the Internet. Web pages include Unks to other wish to read news articles from news groups or bulletin 
web pages, so that a user "surfing" the World-Wide Web ^ board postings on Usenet. In this case, a user executes a 
with a "browser'* application can easily visit related sites "news reader" application, which coordinates the transfer of 
with a click of a button. Consequently, Internet service unread or otherwise desired articles from ISP host 450 or 
providers (ISPs) are deploying host computer systems sited from a news server on Internet 460. 
on the Internet. These host computer systems coordinate the As another example, the user may wish to access home 
flow of email, provide storage for web pages, and enable ^ pages on the World Wide Web. In this case, the user executes 
users at a personal computer to connect with the Internet. a "browser," e.g. Navigator™ available firom Netscape 

A lot has to happen, however, before a user can connect Communications Corp. or the Internet Explorer™ available 
to the Internet. FIG. 4 depicts a typical Internet access firom Microsoft Corp. The browser application coordinates 
network used by an Internet service provider to enable one the downloading of related files from ISP host 450 or other 
of its customers to use the Internet. A user at a personal 30 sites on the Internet 460. These files comprise text files, i.e. 
computer (PQ, for example user PC 410fl, executes locally home pages coded in the HyperText Markup Language 
resident network software to initiate a connection with an HTML, graphics files, commonly encoded in such formats 
Internet service provider. When executed, the network soft- as GIF or JPEG, audio files, and other kinds of files, 
ware causes modem 412a to dial a predefined telephone As the user base for the Internet increases, Internet service 
number for the Internet service provider over a telephone 35 providers have to support a growing number of customers, 
hne. The telephone caU is routed by a central oflSoe tele- Consequently, the performance and reUability of their net- 
phone switch 420 to a network access server 430 belonging work access servers 430 under peak demand times become 
to the Internet service provider. The link between the central crucial. 

office telephone switch 420 can be a multiplexed Imc, such For example, some unreliable network access servers 

as a Tl line or a Primary Rate Interface (PRI) type ISDN undergo a loss of throughput for a high number of calls, 

hnk. Other network access servers may lose throughput if one of 

The network access server 430, also known as a "remote the connected users is downloading a very large binary file 

access server" (RAS), is a combination of a modem bank (e.g. a 2 megabyte graphics file). Some can only support a 

and a high-end router. The incoming telephone call is limited number of concurrent dial ups, even though the total 

automatically directed to one of the modems (not separately 45 number of modems is greater. Other network access servers 

shown) belonging to the network access server 430, typi- run fine for a week, only to spontaneously reboot, discon- 

cally assigned in a round -robin fashion. For example, the necting all the users. 

dial up number can be a lead number in a multi-line himt To ensure reliability of network access servers before the 

group, so that a second, concurrent incoming telephone Internet service providers go on-hne with real customers, the 

would be automatically "rolled over" to the next modem. In 50 vendors of network access servers need some system and 

this manner the network access server 430 allows a plurality methodology to effectively test the access network compo- 

of users, for example at user PCs 410a, 4106, and 410c to nenls. Systems already exist for some low level aspects of 

access the Internet via modems 412fl, 4126, and 412c, the network, for example, electrical functions. Some manu- 

respectively. facturers have load tested their own network elements by 

Accordingly, one of the modems on the network access S5 manually initiating calls and data commimications from a 

server 430 answers the telephone call and undergoes a plurality of PCs. 

modem handshaking procedure with the source modem Such testing, however, is not scalable nor standardized, 

412a. When the modem handshaking is complete, the net- and it is di£5cult to test high stress conditions. For example, 

work access server 430 provides access to a host computer a vendor of a network access server capable of supporting 

system 450 of the Internet service provider via a local area 60 twenty-four concurrent connections may only use twelve 

network 440 such as an Ethernet network. The host com- PCs with modems for testing, due to the limited number of 

puter system 450, also referred to as "ISP host 450," is testers and financial resources in the quality assurance 

typically a mini-computer or high end PC running a multi- department. Thus, the network access server can be tested 

process operating system, such as the Unix™ operating for up to half the total theoretical number of concurrent dial 

system or the Windows NT^" operating system. 65 ups, twenty-four. However, during actual operation, it is not 

Many ISP hosts 450 are configured to use the "point- to- uncommon for twenty-four customers to dial in at the same 

point protocol" (PPP) for communication with one of the time. 
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For example, if the network access server reboots and FIG. 1 is a block diagram of a computer system upon 

disconnects connected users, those users typically attempt to which the present invention can be implemented, 

reestablish their connections all at the same time. Therefore, piG. 2 is a diagram of a network access server testing 

conventional methods are unable to test likely usage patterns network according to an embodiment of the present inven- 

of network access servers. S jion. 

DISCLOSURE OF THE INVEOTION , ^ ^ flowchart iUustrating the operation of simu- 

latmg user traffic according to an embodiment of the present 

There is a need for a system and methodology to test invention, 

network access servers under high stress conditions and with FIG. 4 is a prior art diagram of an exemplary network that 

likely usage patterns. A need also exists for an automatic furnishes a user with access to the Internet, 
network access server testing method and system. 

Tliesc and other needs are met by the present invention, BEST MODE FOR CARRYING OUT THE 

in which a test computer system with a bank of communi- INVENTION 

cations interfaces is coupled to a network access server via ^ method and system for testing network access servers 

a telephone switch and is configured to simulate multiple, ^re described. In the following description, for purposes of 

concurrent users using the network access server. explanation, numerous specific details are set forth in order 

Accordingly, one aspect of the invention is a network for lo provide a thorough imderstanding of the present inven- 

testing a network access server. The network includes a test tion. It will be apparent, however, that the present invention 

computer system. The test computer system has more than 20 may be practiced without these specific details. In other 

one communications interfaces, such as modem or ISDN instances, well -known structures and devices are shown in 

cards, each of which is coupled to a telephone switch. The block diagram form in order to avoid unnecessarily obscur- 

network access server is coupled to the telephone switch and ing the present invention. 

to a host computer system. The test computer system is accordance with one embodiment of the present 

configured to simulate a programmed number ot concurrent 25 invention, a network access server is tested within a network 

_uscrs. j -or eacn simuiatea user, the test computer sysienr automated procedures executed by a test computel'^sys-"' 

initiates a connection with the host computer system via the tgm. The test computer system is capable of simulating a 

network access server and transfer data, e.g. textual data, plurality of concurrent users, accessing a host computer 

compressed data, and graphical data, between the test com- system via the network access server. It may be helpful to 

puter system and host computer system through the network 30 discuss first how the test computer system and the host 

access server. computer system can be implemented. 

Concurrent usage of the network access server by 

multiple, simulated users from the test computer system Hardware Overview 

enables a large number of the modems on the network access ^ ^ ^ ^^^^^ diagram which illustrates a computer 

server to be automaticaUy and substantially simultaneously 35 ^^^^^^ ^^^^ ^^^^^ components of an embodiment of 

exercised. Thus, a network access server can be stress-tested invention may be implemented. The computer system 

at a usage level that is likely to occur m a deployed IQQ may server as a test computer system or a host computer 

environment. ^j^slem, as discussed in detail later. 

Another aspect of the invention is a method and computer Computer system 100 includes a bus 102 or other corn- 
readable medium bearmg mstructions for testmg a network munication mechanism for communicating information, and 
access server. A table is acces sed containing a plurality o f ^ processor 104 coupled with bus 102 for processing infor- 
entncs indicative of respective simulated users, hor at leaSt ^^^^^ Although only a single processor 104 is depicted in 
some of the entries, a connection is initiat^dbetween a test ^ ^ understood, as well-known in the art, that 
computer system and a host computer system through the computer system 100 can include one or more processors 
network access server and data is transferred therebetween, executing in parallel. 

preferably using source and destination IP (Internet _ , ^ mn 1 • 1 j mc 
. IX J J . • f L • i \j Computer system 100 also mcludes a mam memory 106, 
protocol) addresses that are unique tor each simulated user. u j ^ m \ \a\ 
Tt r ■ Trt J J J • J * • *• rn such as a random access memory (RAM) or other dynamic 
Use of unique source IP addresses and umque desUnaUon IP ^ , . . , . . _ /J^ „f„™..™ 
7 u • i.j f 1* . 4U J* ■ <• storage device, coupled to bus 102 for stormg information 
addresses for each simulated user facihtales the diagnosis of j ? , *• * u u,, ia^ xji.i„ 
- , J J . f .1. . . J so and instructions to be executed by processor 104. Mam 
faults discovered during the course of the test and ensures ^" 1 l j r * • * 
, , , , . ,t . 1 ■ A 11 memory 106 also may be used for stormg temporary van- 
that each modem m the network access server is fully .... j- . - r *• j • *• p 
. ^ ^ ables or other intermediate m formation durmg execution of 

instructions to be executed by processor 104. Computer 

Additional objects, advantages, and novel features of the ^^^^^^ ^^^j. includes a read only memory (ROM) 108 

invention will be set forth in part in the description which ^^^^ ^^^^ g^Qj^ge device coupled to bus 102 for storing 

follows, and in part will become apparent upon examination ^^^^^ information and instructions for processor 104. A 

of the following or may be learned by practice of the ^^^^^^^ ^^^^^^ sy^h as a magnetic disk or optical disk. 

invention. The objects and advantages of the invention may provided and coupled to bus 102 for storing information 

be realized and attained by means of the instrumentalities instructions 

and combinations particulariy pointed out in the appended Computer system 100 may be coupled via bus 102 to a 

display 112, such as a cathode ray tube (CRT), for displaying 

BRIEF DESCRIPTION OFTHE DRAWINGS information to a computer user. An input device H 

mg alphanumenc and other keys, is coupled to bus 102 for 

The present invention is illustrated by way of example, communicating information and command selections to 

and not by way of limitation, in the figures of the accom- 65 processor 104. Another type of user input device is cursor 

panying drawings and in which like reference numerals refer control 116, such as a mouse, a U^ackball, or cursor direction 

to similar elements and in which: keys for communicating direction information and com- 
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mand selectioos lo processor 104 and for controUing cursor Internet example, a server might transmit a requested code 

movement on display 112, This input device typically has for an application program through the network 122, such as 

two degrees of freedom in two axes, a first axis (e.g., x) and the Internet, a connection with an ISP, or local network, and 

a second axis (e.g., y), which allows the device to specify communication interface 118. In accordance with the 
positions in a plane. 5 invention, one such downloaded application provides for 

The invention is related to the use of computer system 100 testing network access servers as described herein, 
to test network access servers. According to one cmbodi- The received code may be executed by processor 104 as 
ment of the invention, testing network access servers is it is received, and/or stored in storage device 110, or other 
provided by computer system 100 in response to one or more non- volatile storage for later execution. In this manner, 
processors 104 executing sequences of instructions con- ^0 computer system 100 may obtain application code in the 
tained in main memory 106. Such instructions may be read form of a carrier wave, 
into main memory 106 from another computer-readable , * . . 
medium, such as storage device 110. However, the Test Network Architecture 
computer-readable medium is not limited to devices such as FIG. 2 depicts a network architecture for testing a network 
storage device 110. For example, the computer-readable 15 access server 230, i.e. the "system under test," according to 
medium may include a floppy disk, a flexible disk, hard disk, an embodiment of the present invention. The te st network 
magnetic tape, or any other magnetic medium, a CD-ROM, comprises at least two cnmputer svstemsT test cbmoulef 
any other optical medium, punch cards, paper tape, any other system 210 and host computer system 250, which can be 
physical medium with patterns of holes, a RAM, a PROM, implemented as described hereinabove with reference to 
and EPROM, a FLASH-EPROM, any other memory chip or ^ computer system 100. Test computer system 210 includes at 
cartridge, or any other medium from which a computer can least one modem bank 212 installed thereon. The modem 
read. Exccutionof the sequences of instructions contained in bank 212 includes a plurality of modems, at least twenty- 
main memory 106 causes processor 104 to perform the four but preferably at least forty-eight, for communication 
process steps previously described. In alternative between test system 210 and network access server 230. 
embodiments, hard-wired circuitry may be used in place of ^5 ^^^^ modem is coupled to a telephone switch 220 and 
or in combination with software instructions to implement thence the network access server 230. The telephone switch 
the invention. Thus, embodiments of the invention are not 220, which may be a central office switch or a testing switch, 
Umited to any specific combination of hardware circuitry ^ configured to route telephone calls for a prescribed 
and software, telephone number to the network access server 230. To 

Computer system 100 also includes a communication reduce cabling, the connection to the telephone switch 220 

interface 118 coupled to bus 102. Communication interface may be over a multiplexed line such as a Tl line or the like. 

108 provides a two-way data communication coupling to a Modems provide an analog connection between the test 

network link 120 that is connected to a network 122. For system 210 and the network access server 230. If the 

example, conrniuoication interface 118 may be an integrated network access server 230 supports digital connections, then 

services digital network (ISDN) card or a modem to provide a is desirable to use a plurality of ISDN cards for testing 

a data communication connection to a corresponding type of digital communications. According to one embodiment of 

telephone line. In fact, some implementations of computer the invention depicted in FIG. 2, both analog and digital 

system 100, for example a test computer system, include a communications can be tested with the addition of a second 

plurality of communication interfaces 118 situated in a test system 214 with a plurahty of ISDN cards 216, for 

modem bank or a bank of ISDN cards. accessing the network access server 230 via telephone 

As another example, for computer systems 100 such as a switch 220. Alternatively, a test system can have installed 

host computer system connected to the Internet, communi- thereon both modems and ISDN cards as the communication 

cation interface 118 may be a local area network (LAN) card interfaces. 

to provide a data communication connection to a compatible The network access server 230 is coupled to one or more 

LAN. Wireless links may also be implemented. In any sucb host computer systems 250 and 252 via a local area network 

implementation, communication interface 118 sends and 240, When a modem call is initiated through one of the 

receives electrical, electromagnetic or optical signals which modems in the modem bank 212 of the test system 210, a 

carry digital data streams representing various types of communications channel between the test system 210 and 

information. the host system 250 is estabHshed via telephone switch 220, 

Network link 120 typically provides data communication the network access server 230, and local area network 240. 

through one or more networks 122 to other data devices. For Consequently, the disclosed configuration allows data to be 

example, such as in the case of a host computer system, transferred between the test system 210 and the host system 

network 122 can be a local area network. Alternatively, for 250 through the network access server 230. 
computer system such as user's PC, network 122 can be the 55 In order to subject the network access server 230 to a high 

"Internet," wherein the network link 120 directly accesses a amount of stress testing, it is desirable to over-engineer the 

host computer or data equipment operated by an Internet testing network. In other words, each of the components 

Service Provider (ISP) Network 122 uses electrical, elec- other than the network access server 230 has a higher 

tromagnetic or optical signals that carry digital data streams. expected performance capability than what is judged to be 

The signals through the various networks and the signals on typical in an installed environment. In this manner, as the 

network link 120 and through communication interface 118, communications load increases, it is preferable for the 

which carry the digital data to and from computer system network access server 230 to be the first component to fail. 

100, are exemplary forms of carrier waves transporting the por example, the test system 210 can be a high-end PC or, 

information. more preferably, a workstation, e.g. one available from Sun 

Computer system 100 can send messages and receive 65 Microsystems. Hie modems in the modem bank 212 can be 

data, including program code, through network 122, net- very high-speed modems. The telephone switch 220 can be 

work link 120 and communication interface 118. In the a specialized testing switch, such as a Telios class 5 switch. 
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rather than a normal central office switch. The coonection to table is sequentially scanned, collecting parameters from 

the local area network can be a 100BaseT Ethernet connec- each entry for spawning a background process to simulate an 

tion. In addition, a plurality of host systems, e.g. hosts 250 individual test user. 

and 252, may be employed to achieve load balancing of the According to one implementation of the present 

requests. s invention, the test program can be controlled even while 

In accordance with subjecting the network access server "'n°i^g ^ "^o^^^^ '^f ^0°^^°! f "^^'^^l 

under test to a high amount of stress, it has been found that * ^^^^^ ^^^^^ ^ P^f ^^^Sf^ location m the file system of 

using a low overhead protocol, e.g. FTP (File Transfer j^sl «)mpuler sy^em 210 To control the execution of the 

n . IV „ »/ : \ • * • • CI £- *L testmg program, the operator wntes a desued command m 

Protocol) or rep (remote copy), in retneving files from Oic control file for example with a text editor or by a 

host computer system 250, is preferable to usmg a higher lO ^^^^^^ ^^^^ ^^^^^^^^ ^ stop>test_contror 

overhead protocol, e.g. HTTP (HyperTcxt Transfer where "tcst__contror is the name of the control file. 

Protocol). Althou^ mrP IS mdeed a commonly used instructions in the test program read the 

protocol, especially by World Wide Web servers and ^^^^^^ predefined file system location. If, for 

browsers, the protocol requires the execuUon of several example, the control file contains the word "stop," then the 

processes on the host computer system 250 to fetch the 15 ^^^^ terminates execution. It is evident that other 

various files that may be requested. ConsequenUy, the host ^^^j^^, ^oj^mands such as "pause" can be implemented 

computer system 250 may get bogged down under the load. . mechanism. 

Since it is desirable to load test the network access server r . * • . * • . ^ , 

--rt u . * *u u » . * -»ci\ t Ki^ If execution of the test program is not tenm mated or 

230, but not the host computer system 250, it is preferable , . j • ,u ^ gi *• « 

, ' , u J * ( u Jttti « « * on paused via a command m the command file, execution 
to use a lower overhead protocol such as FTP or rep to*or 

lu ur^ tt iuwci u s^iu^wa j^iutu^^i du u ^ ^ procceds to Step 306, where a background process is 

transfer data between the host computer system 250 and the ^ - i,- «««Jlt^«- 

--^ f / spawned for simulatmg a user based on parameters read 

test computer system ziu. ^^^^ ^^^^ table. According to one embodiment of the 

Alternatively, it is also desu-able to perform the testmg ^^^^^^ invention, the test program executes a parameterized 
procedures in a network configuration that is typical of the -test^u scr^' modul e 310 in the hacVcn-min d. The tes| y ser 
actual deployment environment for the network access ^ ^^S^CTTenc^ates the steps 312-318 in a computer- 
server 230. For example, the telephone switch 220 can be an -TSffigS^medium, e.g. in the form of an executable binary 
actual central office telephone switch. As another example, containing machine language instructions or a shell 
lower speed modems m the modem bank 212 may be script (e.g. Kom shell, Bourne shell, C shell, etc.) containing 
employed. In yet another example, common, but high interpreted instructions. Parameters may be passed from the 
overhead, protocols such as HTTP may be used to transfer ^^^^ pro^^m to the test_user module 310 as command line 
data between the host computer system 250 and the test parameters, environment variables, data in a file, or through 
computer system 210. ^^^^^ techniques known in the art including a combination of 

This alternative approach may imcover failures in the jtie above mentioned techniques, 
network access server 230 due to poorly functioning equip- Spawning a process into the background allows for a 
ment elsewhere in the network. These approaches are piurahty of processes to be concurrently executed, for 
complementary, and it is contemplated that a thorough test example, by time sharing. More specifically, the test 
of a network access server 230 would involve testmg the program, the "parent process," interacts with the multi- 
device under both configurations. process operating system to create another process or "child 
SimulaUng Multiple, Concurrent Users *o process.^' Once created, the child process is effectively 
* ^ independent of the parent process and is executed concur- 

One aspect of the invention relates to the use of a test rently by the operating system. In particular, the test pro- 

system 210 to simulate a plurality of user s concurrently ^r-.^ arranges for the child process to execute the instruc- 

jestablishina connections ana transferring data with the host (ions in the test_user module 310. 

system 25\) (and/or tiosl system 252) via the network access ^ well-known in the art, background processes can be 

server 230. Accordingly, the test system 210 is preferably a spawned in various ways depending on the operating envi- 

compuler system running a multi-processing or multi- ronment and implementation of the test program. 11 the test" 

tasking operating system, in which the usage patterns of program is implemented as a shell script, e.g. a Korn shell 

each user is simulated in a separate, concurrenUy executing gcnpt running under the Unix^w operating system or the 

process. jq Microsoft Windows NT'''*^jQp eratin g system , then the test_ 

For ease of configuration, a table or flat file is stored at the user niodule 310 may be spa\Vn6d by appending an amper- 

test system 210 having an entry for each test tiser in the sand ("&") after the command line involdng the modtile. As 

simulation. Each entry includes such information as an another example, if the lest program is written in a compiled 

identifier for the user, a telephone number to dial, and a systems programming language such as C, then the test_ 

"command set" of tests to be run by the user. It is evident 55 user module 310 may be spawned under the Unix**"" oper- 

that the entry may be augmented to include other test ating system by executing a "fork" operating system com- 

user-specific information as needed, for example the name mand to create a chUd process, followed by an "exec" 

of the host computer system 250 or 252. command in the child process with the file name of the 

The network access server test is commenced by execut- test_user module 310. 

ing a computer program on test computer system 210. This 60 Concurrent execution of the test program and an instance 

lest program is responsible for spawning a plurality of of the test_user module 310 may be simultaneous if the test 

background processes, each process for the purpose of computer system 100 includes a plurality of processors, or 

simulating a user according to a respective entry in the test substantially simultaneous on a single processor by altema- 

uscr table. lively dedicating small slices of time to the two processes. 

Referring to FIG. 3, when the test program is executed, 65 A parent process can spawn a plurality of chUd processes, 

the table of test users is accessed, starting at the beginning each of which are executing concurrently and independently 

of the table (step 300). In a loop controlled by step 302, the of each other. 
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As described in more detail hereinafter with reference to extended by adding another digit or expressing the serial 

steps 312-318, the spawned tesl_user module 310 simulates number in hexadecimal The "SI" portion of the exemplary 

a lest user in the background. After spawning the lest_user user identifier indicates the desired system under test, since 

module 310, cxccuUon begins in the tcst_uscr module 310 it is possible to test a plurality of network access servers 230 
and concurrently continues in the test program, looping back s in this configuration. Generally, the value of the final digit 
to step 302. According to one implemcnUtion of the present the "S'* is correlated with the telephone for diaUng the 

invention, execution of the lest program immediately loops desired network acces server 230, For example, SI may 

back to step 302 so that communicaUon interfaces for a correspond to a telephone number of 555-1212 to access a 
pluraUty, for example a dozen, of simulated users would server and S2 may correspond to 

f . ... ' 1 --ift , 555-1313 to access a second network access server. This 

imtiatc a connection with the network access server 230 at lo . , . ^ j * . n u -j j • *u 

. , II _ T, , . u «r unique user identifier need not actually be recorded m the 

substantially the same time. To randomize the behavior of ^ , . • . , - c -i t-i • 

tu ♦ « i, ^ c-„«, .^^iU^T ;rr.r.^^ tcst uscr table, only derivable fi-om mformation available m 

the network access server test according to another imple- , , 4l • i- ^- - .i. * . * 

mentation of die present invention, the test program is the test user tabk. Tlius, the mfo^ation in t 

programmed lo wail (or "sleep") a random number of can be entered m a more liser-fnendl/ format, e.g. spea- 
seconds (e.g. two to four seconds) before looping back to 15 the user as userUUtr . 

steo 302 ^° process executmg the test_user module 

. . .1. . 1 u 1 * . 310 initiates a connection with the host computer system 

When execution in the tes program loops back to step ^^^^ ^52 as the case may be) via 

302, which occurs concunrendy with a spawned instance of ^^^^^^^ ^^^/^ ^30 under test. THis connection is 

the test_user module 310, a subsequent entry m the test user ^^.^^^ ^ ^ ^^^^^ ^^^^^ ^^^^^ 212 to dial 
tabic IS processed. Steps 304 and 306 are oonscqucnUy 20 desired telephone number There are various approaches 
performed, resulting m the spawn mg of another process of determining which modem of the modem bank 212 is to 
the test_uscr module 310. This other tcst_uscr process ^^^^ ^ -^^^^^ simulated test user, but the present 

executes mdependently of and concurrently with previously ^^^^^.^^ ^ j.^.^^^ ^^^^^j^^ ^pp^^^^j^ 

spawned test_uscr processes. example, the modem can be assigned on a round-robin basis 

After all the entries in the test user table have been treating the modem bank 212 as a modem pool. As 

processed in step 302, the test program optionally waits a another example, a modem can be dedicated to a specific 

random amount of time (e.g. two to four seconds) and simulated test user, correlated via the serial number of the 

returns to step 300 to reiterate through the test user table y^^^ encoded in the user identifier. 

again. In this manner a test of a network access server 230 y^^^^ ^^^^^ ^^^^^ 212 is directed to dial 
can continue indefinitely, perhaps for weeks, until problems appropriate number for the network access server 

with the network access server 230 become evident or the 230, the telephone call is routed by telephone switch 220 to 
test program is terminated, for example, through the control network access server 230. When the network access 

file inspected in step 304. In addition, the test user table can ^^^^^ 230 receives that telephone caU, the caU is answered 
be changed by person while the simulation is runnmg to ^j^^ modems belonging to the network access 

dynamically modify the behavior of the network access ^^^^^ 230. GeneraUy, the test computer system 210 is not 

server lest, ^^^^ control which modem on the network access server 

Simulating a Test User ^30 will respond to a particular telephone caU^ Most com- 

^ mercial network access servers 230 under test, however, are 

As previously explained, a parameterized test_user m od- configured to record logging information such as user iden- 

ule 310 is spawned in the background at step 306 Iter tifiers or IP addresses for each modem on the network access 
^ulating a test uscr.<Lhe test_m odule 3 10 is configured to j server 230. Thus, it is possible to determine fi-om the logging 
■^ceive a plurality of paramete rs liiat'tUfecl' how a particular y information which modems on the network access server 

4£st user is to be simulated j Tn a speciftc example, the 230 correspond to which simulated test users have failed, 
parameters include a unique user identifier of the simulated 45 When the call is answered by one of the modems of the 

test user, a telephone number for one of the modems in the network access server 230, the sending and receiving 

modem bank 212 to dial to reach the network access server modems undergo a standard handshaking procedure. 

230 under test, and a "command set" of tests to be run by the Modem handshaking involves such activities as determining 

user. Generally, these parameters are derived from a respec- the baud rate or transmission speed of signal between the 
tive entry in the test user table fetched during the execution jq two modem, and other low-level communications items, 

of step 302. When the handshaking has successfully completed, the 

In order to facilitate the simulation of a test user, each network access server 230 establishes a link via local area 

simulated test user is preferably assigned t he unicjue user network 240 to the host computer system 250 to negotiate a 

identifiei, which includes an encoding of a unique serial PPP connection. Under normal operating conditions, nego- 
numbcr. For example, a user identifier can be of the form 55 tiating a PPP connection involves authentication and the 

"AOIOOSI", where the "A" p ortion of the user identifier assignment of an IP address within a block of IP addresses 

indicates that ;^na1np ^ mndcms in the modem bank 212 are to the test computer system 210. 

used. If, on the other hand, ISDN cards 216 are used, then Authentication involves checking the uscr identifier and 

the user identifier would commence with a "D" to indicate optionally a password against a list of authorized users to 

a digital connection. The "01" in the user identifier determine whether the user is authorized to make the con- 

^UlOOAl" lllUiUlti' which one of a plurality of lest com- nection. After a successful authentication, an IP address is 

puter systems is being employed. In this case, the "01" assigned to the user's computer system. This assignment is 

indicates the first test computer system 210, usually made on a dynamic basis, depending on which IP 

The "00" of the exemplary user identifier "AOIOOSI" is a addresses in the block of IP addresses are already in use. 
serial number of the simulated user, which, in this format, 65 According to a preferred embodiment of the invention, 

are decimal digits indicating one of a himdred users. It is however, a imique IP address is assigned during the PPP 

evident, of course, that support for more users can be negotiation based on the user identifier. 
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There are various approaches to assigning an IP address 210 side and on the host computer system 250 side. Unique 

based on the user identifier. One such approach is to assign destination IP addresses are preferably assigned by includ- 

an IP address from the explicitly reserved block of class A ing the serial number for the user in one of the octets of the 

addresses with an octet including the serial number encoded destination IP address. For example, a first simxilated test 
within the user identifier. For example, for user identifier 5 user may use "10.1.0.101" as the source IP address for the 

"AOIOOSI", the corresponding IP address assigned may be test computer system 210 and "172.22.0.206" as the desti- 

"10.1.0.10r*where the third octet "0" includes the serial nation IP address for the host computer system 250. 

number. In this IP address, the first octet "10" indicates the Accordingly, a second simulated test user may use 

reserved block of class A addresses; the second octet "1" "10.1.1,101" as the source IP address for the test computer 
indicates the first test computer system 210; the third octet lo system 210 and "172.22.1.206" as the destination IP address 

"0" includes the user serial number; and the fourth octet for the host computer system 250. In both these examples, 

"101" is not used. It is evident that the present invention is the third octet includes the serial number of the simulated 

not limited to this particular addressing scheme. In fact, the test user, 

information in the second and third octets can be placed in y^ter establishing the connection in step 312, execution 
the fourth octets in other embodiments. Not using the fourth 15 proceeds to step 314, which controls a loop for performing 

octet information allows the IP address to be truncated in a t^e various tests involving data transfers a random number 

log file without losing meaningful information. of times, e.g. four to nine times. Randomizing the number 

One of the benefits of putting the serial number of the user times a test is optional but preferable, in order to subject the 

in the IP address is that the particular simulated test user can network access server 230 lo a greater variety of different 
be identified easily from examination of the IP address used ^ combinations of data transfers. 

by the test user. For example, a straightforward inspection of [q step 316, test data is transferred by executing a standard 

an IP address such as "10.1.0.101" readily yields the test Internet utility between test computer system 210 and host 

computer system and the simulated test user, in this computer system 250 via a modem on modem bank 212, 

example, the first test computer system 210 and simulated telephone switch 220, network access server 230, and local 
test user 00. ^ area network 240. The IP addresses used for these standard 

Another benefit relates to how IP packets are convention- Internet utilities are the unique IP addresses assigned for 

ally routed between networked computer systems. Typically, each simulated test user. 

networked computer systems employ dynamic routing tech- The FTP (file-transfer protocol) utility has been found to 

niques in which an IP packet is not sent directly to the be especially beneficial due to the relatively low overhead 

destination computer system but forwarded to a related imposed on the host computer system 250. The FTP utility 

computer system. This conventional approach is intended to is configured to accept a file containing a list of commands 

simplify the routing procedures. for transferring a file between the test computer system 210 

For example, a test computer system 210 may connect to and the host computer system 250. The name of command 

the host system 250 via the network access server 230, file can be passed into the tesl_user module 310 as the 

having assigned thereto IP addresses of "10.1.0.101" and "command set" parameter. 

"10.1.1,101", for two simulated test users respectively. An exemplary FTP command is "get /tmp/filename" 

Under dynamic routing techniques, a host computer system where "/tmp/filename" is a predetermined name of a file \(\ 

250 may send all packets back to test computer system 210, resident on the file system of the host computer system 250. ^^^^^ 

through the same connection established between the two This command directs the host computer system 250 to fetch \\j 'nJ^ 

computer systems, because the IP addresses are of the same the file called "/tmp/filename" in its file system for down- ^ 

form "10.1.*.*" where "*" indicates any octet value. In this loading to the test computer system 250 using the TCP/IP ^ 

example, data destined for the IP address "10.1.1.101", protocol (Transmission Control Protocol/Internet Protocol). 

corresponding to the second simulated test user, is sent over Since many files are downloaded during the test, the down- 

the connection for the first test user and hence over the same loaded file is preferably immediately deleted or downloaded 

modem in the network access server 230. Consequently, directly to a zero-byte storage null device, such as "/dev/ 

only one modem, under conventional dynamic routing null" on the Unix*^*** operating system or "nul:" on operating _ 

techniques, of the plurality of modems in the network access systems available from Microsoft Corp. 

server 230 is being exercised during the test. The downloaded files can be a mix of text files, containing ^^^^ 

Accordingly, the test network is configured to use static 50 textual data in the form of printable ASCII characters, - r 

routing when transferring data between the test computer compressed text files, graphics files, executable files, etc. 

system 210 and the host computer system 250. Static routing These files can also be of various sizes. Since many network 

prohibits the forwarding of IP packets to another computer access servers 230 include modems that can automatically 

system by specifying the direct path the data transferred in compress textual data, it is desirable to include uncom- 
IP packets are sent. Thus, each modem in the network access 55 pressed text files among the files to be downloaded. Sending 

server 230, through which a connected is made by a simu- binary information in the form of compressed files, graphics 

latcd test user, can be fully exercised during the test. Both files, or executable files is also desirable because they load 

the host computer system 250 and the test computer system the modems in a different manner. 

210 are configured to build the static routing table. These [t is contemplated that implementations of the present 

static routes can be buUl at boot-time, especially for host invention may use other utilities for transferring data 

computer system 250, or immediately after establishing a between test computer system 210 and host computer sys- 

connection through network access server 230, especially tem 250. For example, data can be transferred with the 

for lest computer system 210. UDP/IP protocol using the TFTP utility (Trivial File Trans- 

In order to expedite the static routing, the host computer fer Program). As another example, news articles, generally 
system 250 is configured to respond to a plurality of desti- 65 containing textual data, can be downloaded with the NNTP 

nation IP addresses, such that each simulated test user utility. Moreover, data can be uploaded through the FTP 

employs a unique IP address on the test computer system utility or through an "rep" (remote copy) utility. In fact, data 
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can also be transferred according to HTTP (HyperText 
Transfer Protocol), but this may yield an unacceptable 
amount of loading the host computer system 250. Each of 
these utilities can be progranmied to perform specified 
operations, e.g. by parameter or by file redirection, which 
can be specified by the "command set" parameter. 

Therefore, via the "command set" parameter, different 
simulated lest users can perform differeat mixes of data 
transfers to simulate the different kinds and lengths of files 
that are typical m a aepioyed, live installation of a network 
access server 230. 

— After the various data transfers have been performed in 
step 316 and after the loop controlled by step 314 terminates, 
the connection between the test computer system 210 and 
the host computer system 250 for the test user being simu- 
lated by the tcst_uscr module 310 is disconnected. Thus, the 
various aspects of a user's session with a host computer 
system 250 belonging to an Internet service provider is 
effectively simulated. 

Generally, the simulation on test computer system 210, 
including additional test computer systems, e.g. test com- 
puter system 214, is run until a problem, fault, error, or 
mistake is noticed for. the network access server 230. At this 
point, the simulation is stopped or paused by means of the 
aforementioned control file. It is contemplated that the test 
program and the test-user module 310 keep very detailed 
logs of the activity performed during the test so that specific 
problems can be easily diagnosed. 

By spawning a plurality of background processes invok- 
ing the test_user module 310 for a respective test user at a 
test computer system 210, multiple numbers of test users can 
be simulated. Accordingly, a testing network and method- 
ology is provided for stress-testing a network access server 
230, Consequently, a more thorough testing of network 
access servers may be attained than in conventional tech- 
niques prior to deployment by an Internet service provider. 

In the foregoing specification, the invention has been 
described with reference to specific embodiments thereof. It 
will be apparent, however, that various modifications and 
changes may be made thereto without departing from the 
broader spirit and scope of the invention. The specification 
and drawings are, accordingly, to be regarded in an illus- 
tr ative rather than a r estrictive sense. 

<^hat ifi 9laim?dlsr:> 

1. A network for testing an network access server, com- 
prising: 

a test computer system having installed thereon a plurality 
of communication interfaces; 

a telephone switch coupled to the communication inter- 
faces of said test computer system and to said network 
access server; 

a host computer system coupled to said network access 
server; 

wherein said test computer system is configured to simu- 
late a plurality of concurrent users, for each said 
simulating user said test computer system performing 
the steps of: 

(a) initiating a connection from said lest computer 
system to said host computer system via said tele- 
phone switch and said network access server; and 

(b) transferring data between said test computer system 
and said host computer system via said telephone 
switch and said network access server. 

2. The network of claim 1, wherein said plurality of 
communication interfaces includes a plurality of modems. 

3. The network of claim 1, wherein said plurality of 
communication interfaces includes a plurality of ISDN 
cards. 
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4. The network of claim 1, wherein said telephone switch 
is a central office switch. 

5. The network of claim 1, wherein said telephone switch 
is a testing switch. 

s 6. The network of claim 1, wherein said host computer 
system is coupled to said network access server via a local 
area network, 

7. The network of claim 1, wherein the step of transferring 
data between said test computer system and said host 
computer system via said telephone switch and said network 
access server includes the step of downloading textual data 
from said host computer system via said telephone switch 
and saki network access server. 

8. The network of claim 7, wherein the step of down- 
loading textual data from said host computer system via said 

^5 telephone switch and said network access server includes the 
step of downloading a text file at a predetermined location 
in a file system of said host computer system via an FTP 
(file-transfer protocol) utility. 

9. The network of claim 7, wherein the step of down- 
20 loading textual data from said host computer system via said 

telephone switch and said network access server includes the 
step of downloading a news article from said host computer 
system. 

10. The network of claim 1, wherein the step of transfer- 
25 ring data between said test computer system and said host 

computer system via said telephone switch and said network 
access server includes the step of downloading a compressed 
text file from said host computer system via said telephone 
switch and said network access server. 

11. The network of claim 1, wherein the step of transfer- 
ring data between said test computer system and said host 
computer system via said telephone switch and said network 
access server includes the step of downloading a graphics 
file from said host computer system via said telephone 

2^ switch and said network access server. 

12. The network of claim 1, wherein said host computer 
system is configured to respond to a plurality of IP (Internet 
protocol) addresses. 

13. A network for testing a network access server, com- 
40 Posing: 

a test computer system having installed thereon a plurality 
of communication interfaces; 

a telephone switch coupled to the communication inter- 
faces of said test computer system and to said network 
45 access server; 

a host computer system coupled to said network access 
server and configured to respond to a plurality of IP 
(Internet protocol) addresses; 

wherein said test computer system is configured to simu- 
50 late a plurality of concurrent users, for each said 
simulating user said test computer system performing 
the steps of: 

(a) initiating a connection from said test computer 
system to said host computer system via said tele- 

55 phone switch and said network access server; and 

(b) U-ansferring data between said test computer system 
and said host computer system via said telephone 
switch and said network access server; 

wherein the step of initiating a connection from said test 
60 computer system to said host computer system via said 
telephone switch and said network access server includes the 
step of assigning a first unique IP address for each simulated 
concurrent user, 

14. The network of claim 13, wherein the step of trans- 
65 ferring data between said test computer system and said host 

computer via said telephone switch and said internet access 
server includes the steps of: 
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determining a secx)nd unique IP address from among said 
plurality of IP addresses; and 

transferring said data using the first unique IP address to 
indicate the test computer system and the second 
unique IP address for the host computer system. 

15. The network of claim 1, wherein the test computer 
system is configured to perform step (b) a random number 
of times for each concurreot user. 

16. The network of claim 1, wherein the test computer 
system is configured to perform step (b) for at least two of 
said concurrent users at substantially the same time. 

17. A method of testing a network access server in a 
network including a test computer system having installed 
thereon a plurality of communication interfaces, a telephone 
switch coupled to said commimication interfaces and to said 
network access server, and a host computer system coupled 
to said network access server, said method comprising the 
steps of: 

accessing a table containing a plurality of entries indica- 
tive of respective simulated users; 

performing the following steps substantially concurrently 
for at least some of the entries in the table: 

(1) initiating a connection from said test computer 
system to said host computer system via a respective 
one of said communications interfaces through said 
telephone switch and said network access server; and 

(2) transferring data between said test computer system 
and said host system through said telephone switch 
and said network access server. 

18. The method of claim 17, wherein step (1) includes the 
step of initiating the connection from said test computer 
system to said host computer system via a modem. 

19. The method of claim 17, wherein step (1) includes the 
step of initiating the connection from said test computer 
system to said host computer system via an ISDN card. 

20. The method of claim 17, wherein step (1) includes the 
step of initiating the connection from said test computer 
system to said host computer through a central of&ce switch 
simulator. 

21. The method of claim 17, wherein the step of trans- 
ferring data between said test computer system and said host 
computer system via said telephone switch and said network 
access server includes the step of downloading textual data 
from said host computer system via said telephone switch 
and said network access server. 

22. The method of claim 21, wherein the step of down- 
loading texmal data from said host computer system via said 
telephone switch and said network access server includes the 
step of downloading a text file at a predetermined location 
in a file system of said host computer system via an FTP 
(file-transfer protocol) utility. 

23. The method of claim 21, wherein the step of down- 
loading textual data from said host computer system via said 
telephone switch and said network access server includes the 
step of downloading a news article from said host computer 
system. 

24. The method of claim 17, wherein the step of trans- 
ferring data between said test computer system and said host 
computer system via said telephone switch and said network 
access server includes the step of downloading a compress 
text file from said host computer system via said telephone 
switch and said network access server. 

25. The method of claim 17, wherein the step of trans- 
ferring data between said test computer system and said host 
computer system via said telephone switch and said network 
access server includes the step of downloading a graphics 
file from said host computer system via said telephone 
switch and said network access server. 
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26. A method of testing a network access server in a 
network including a test computer system having installed 
thereon a plurality of commimication interfaces, a telephone 
switch coupled to said communication interfaces and to said 
network access server, and a host computer system coupled 
to said network access server, said method comprising the 
steps of: 

accessing a table containing a plurality of entries indica- 
tive of respective simulated users; 

performing the following steps substantially concurrently 
for at least some of the entries in the table: 

(1) initiating a connection from said test computer 
system to said host computer system via a respective 
one of said communications interfaces through said 
telephone switch and said network access server; and 

(2) transferring data between said test computer system 
and said host system through said telephone switch 
and said network access server, the step of transfer- 
ring data comprising downloading a graphics file 
from said host computer system via said telephone 
switch and said network access server; 

and further comprising the steps of: 

assigning a first IP address indicative of the lest com- 
puter system and a second IP address indicative of 
the host computer system, wherein said first IP 
address and said second IP address are unique for 
each simulated user; 

establishing statically a route between said first IP 
address and said second IP address; and 

wherein the step of transferring data between said test 
computer system and said host computer system via 
said telephone switch and said network access server 
includes the step of transferring said data using said 
first IP address to indicate the test computer system 
and said second IP address to indicate the host 
computer system. 

27. The method of claim 26, wherein the step of assigning 
a first IP address indicative of the test computer system and 
a second IP address indicative of the host computer system 
includes the steps of: 

assigning the first IP address with an octet thereof con- 
taining a serial number of one of the simulated users; 
and 

assigning the second IP address with an octet thereof 
containing the serial of said one of the simulated users. 

28. The method of claim 17, further comprising the step 
of performing step (2) a random number of times for each of 
the at least some of the entries in the table, 

29. The method of claim 17, further comprising the step 
of performing step (2) at substantially the same time for at 
least two of the entries in the table. 

30. The method of claim 17, said sequences of instruc- 
tions further comprise sequences of instructions for perform- 
ing the step of performing step (2) at substantially the same 
time for at least two of the entries in the table. 

31. A computer readable medium bearing sequences of 
instructions for testing a network access server in a network 
including a test computer system having installed thereon a 
plurahty of communication interfaces, a telephone switch 
coupled to said communication interfaces and to said net- 
work access server, and a host computer system coupled to 
said network access server, said sequences of instructions 
comprising sequences of instructions for performing the 
steps of: 

accessing a table containing a plurality of entries each 
indicative of a distinctive simulated user; 
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performing ibe following steps substantially concurrently 
for a plurality of the entries in the table: 

(1) initiating a connection from said tesi computer 
system to said host computer system via a respective 
one of said communication interfaces through said 5 
telephone switch and said network access server; and 

(2) transferring data between said test computer system 
and said host system through said telephone switch 
and said network access server. 

32. The computer readable medium of claim 31, wherein 10 
step (1) includes the step of causing a modem to initiating 
the comiection from said test computer system to said host 
computer system. 

33. The computer readable medium of claim 31, wherein 
step (1) includes the step of causing an ISDN card to initiate 15 
the connection from said test computer system to said host 
computer system. 

34. The computer readable medium of claim 31, wherein 
step (2) includes the step of downloading a text file at a 
predetermined location in a file system of said host computer 20 
system via an FTP (file-transfer protocol) utility. 

35. The computer readable meditun of claim 31, wherein 
step (2) includes the step of downloading a news article from 
said host computer system. 

36. A computer readable medium bearing sequences of 25 
instructions for testing a network access server in a network 
including a test computer system having installed thereon a 
plurality of communication interfaces, a telephone switch 
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coupled to said communication interfaces and lo said net- 
work access server, and a host computer system coupled to 
said network access server, said sequences of instructions 
comprising sequences of instructions for performing the 
steps of: 

accessing a table containing a plurality of entries each 
indicative of a distinctive simulated user; 

performing the following steps substantiaUy concurrently 
for a plurality of the entries in the table: 

(1) initiating a connection from said test computer 
system to said host computer system via a respective 
one of said communication interfaces through said 
telephone switch and said network access server; and 

(2) transferring data between said test computer system 
and said host system through said telephone switch 
and said network access server wherein step (2) 
includes the step of transferring said data using a first 
IP address to indicate the test computer system and 
a second IP address to indicate the host computer 
system, wherein said first IP address and said second 
IP address are unique for each other. 

37. The computer readable medium of claim 31, wherein 
said sequences of instructions further comprise sequences of 
instructions for performing step (2) a random number of 
times for each of the at least some of the entries in the table. 
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